Hyper-optimized tensor network contraction
نویسندگان
چکیده
Tensor networks represent the state-of-the-art in computational methods across many disciplines, including classical simulation of quantum many-body systems and circuits. Several applications current interest give rise to tensor with irregular geometries. Finding best possible contraction path for such is a central problem, an exponential effect on computation time memory footprint. In this work, we implement new randomized protocols that find very high quality paths arbitrary large networks. We test our variety benchmarks, random circuit instances recently implemented Google chips. obtained can be close optimal, often orders or magnitude better than most established approaches. As different underlying geometries suit methods, also introduce hyper-optimization approach, where both method applied its algorithmic parameters are tuned during finding. The increase schemes found has significant practical implications particularly benchmarking Concretely, estimate speed-up over 10,000×compared original expectation Sycamore `supremacy'
منابع مشابه
Tensor Contraction&Regression Networks
To date, most convolutional neural network architectures output predictions by flattening 3rd-order activation tensors, and applying fully-connected output layers. This approach has two drawbacks: (i) we lose rich, multi-modal structure during the flattening process and (ii) fully-connected layers require many parameters. We present the first attempt to circumvent these issues by expressing the...
متن کاملStrassen's Algorithm for Tensor Contraction
Tensor contraction (TC) is an important computational kernel widely used in numerous applications. It is a multi-dimensional generalization of matrix multiplication (GEMM). While Strassen’s algorithm for GEMM is well studied in theory and practice, extending it to accelerate TC has not been previously pursued. Thus, we believe this to be the first paper to demonstrate how one can in practice sp...
متن کاملCommunication Lower Bounds for Tensor Contraction Algorithms
Contractions of nonsymmetric tensors are reducible to matrix multiplication, however, ‘fully symmetric contractions’ in which the tensors are symmetric and the result is symmetrized can be done with fewer operations. The ‘direct evaluation algorithm’ for fully symmetric contractions exploits equivalence between terms in the contraction equation to obtain a lower computation cost than the cost a...
متن کاملHigh-Performance Tensor Contraction without Transposition
Tensor computations–in particular tensor contraction (TC)–are important kernels in many scientific computing applications (SCAs). Due to the fundamental similarity of TC to matrix multiplication (MM) and to the availability of optimized implementations such as the BLAS, tensor operations have traditionally been implemented in terms of BLAS operations, incurring both a performance and a storage ...
متن کاملAudiometric findings with voluntary tensor tympani contraction
BACKGROUND Tensor tympani contraction may have a "signature" audiogram. This study demonstrates audiometric findings during voluntary tensor tympani contraction. METHODS Five volunteers possessing the ability to voluntarily contract their tensor tympani muscles were identified and enrolled. Tensor tympani contraction was confirmed with characteristic tympanometry findings. Study subjects unde...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Quantum
سال: 2021
ISSN: ['2521-327X']
DOI: https://doi.org/10.22331/q-2021-03-15-410